GENERALIZED DIFFERENTIATION WITH 
POSITIVELY HOMOGENEOUS MAPS: APPLICATIONS 
IN SET- VALUED ANALYSIS AND METRIC REGULARITY 
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Abstract. We propose a new concept of generalized differentiation of set- 
valued maps that captures first order information. This concept encompasses 
the standard notions of Frechet differentiability, strict differentiability, calm- 
ness and Lipschitz continuity in single- valued maps, and the Aubin property 
and Lipschitz continuity in set- valued maps. We present calculus rules, sharpen 
the relationship between the Aubin property and coderivatives, and study how 
metric regularity and open covering can be refined to have a directional prop- 
erty similar to our concept of generalized differentiation. Finally, we discuss 
the relationship between the robust form of generalized differentiation and its 
one sided counterpart. 
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1. Introduction 

We say that 5* is a set-valued map (or a multi-valued function, or multifunction) 
if for all X G X, S{x) is a subset of Y, and we denote set- valued maps hy S : X ^ Y. 
Many problems of feasibility, control, optimality and equilibrium are set-valued in 
nature, and are best treated with methods in set-valued analysis. The texts [4j[5j[23] 
contain much of the theory of set-valued analysis. Set-valued analysis serves as a 
foundation for the theory of differential inclusions [3J [5], control theory [T3] and 
variational analysis |40l 1321 [T^ . which in turn have many applications in applied 
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mathematics. We refer to these texts for the abundant bibhography on the history 
of set-valued analysis. 

The main contribution of this paper is to introduce a new concept of generalized 
differentiation (Definitions 14.11 and 14. 6p using positively homogeneous maps. Any 
reasonable definition of a derivative for set-valued maps has to describe changes 
in the set in terms of the input variables. Using the Pompieu-Hausdorff distance 
(a metric on the space of nonempty compact sets), one obtains the classical defi- 
nition of Lipschitz continuity of set-valued maps. The concept introduced in this 
paper provides a more precise tool that incoporates first order information in a set- 
valued map, encompassing the standard notions of Frechet differentiability, strict 
differentiability, calmness and Lipschitz continuity in single-valued maps, and the 
Aubin property and Lipschitz continuity in set-valued maps. We illustrate how this 
new concept relates to, and extends, existing methods in variational and set-valued 
analysis. To motivate our discussion, we revisit the relation between the Clarke 
subdifferential and Clarke Jacobian and the nonsmooth behavior of functions that 
can be traced back to |19| . 

Other than the first four sections which provide the necessary background for the 
rest of the paper, the last four sections can be read in any order. In Section|3l we re- 
call generalized differentiation for single-valued functions, which was first proposed 
by loffe P^ll9j . We relate the generalized derivative to common notions in classical 
and variational analysis, paying particular attention to the Clarke subdifferential 
and the Clarke Jacobian. In Section HI we define generalized differentiation for 
set-valued maps, and illustrate the lack of relation between our generalized deriva- 
tives and the notions of set-valued derivatives based on the tangent cones, namely 
semidifferentiability [M] and proto-differentiability [321 . We present calculus rules 
in Section [SI 

The Aubin property (see Definition 14. 7|) . which is commonly attributed to [1], is a 
method of analyzing local Lipschitz continuity of set-valued maps. In Section [6l we 
revisit the classical relationship between the Aubin property and the coderivatives 
of a set-valued map. This relationship is referred to as the Mordukhovich criterion 
in |40| . Since the coderivatives of a set- valued map can be calculated in many 
applications and enjoy an effective calculus, this relationship is an important tool 
in the study of the Lipschitz properties of set-valued maps. We will show that 
the coderivatives actually give more information on the local Lipschitz continuity 
property in our language of generalized derivatives. 

It is well known that the Aubin property is related to metric regularity and open 
covering [6l I30[ [35] . Open covering is sometimes known as linear openness. Metric 
regularity is important in the analysis of solutions to e S{x), while open covering 
studies local covering properties of a set-valued map. Both metric regularity and 
open covering can be viewed as a study of set-valued maps whose inverse has the 
Aubin property. For more on metric regularity, we refer the reader to [401 [3H [T31 
\n\ [55] . In Section [T] we take a new look at metric regularity and open covering in 
view of our definitions of the generalized derivatives. We study metric regularity 
and open covering in a much broader framework, illustrating that a directional 
behavior similar to that in our definition of generalized derivatives is present in 
metric regularity and open covering. 

In Section[51 we discuss how the (basic and strict) generalized derivatives defined 
in Sections[3]and[4]relate to each other. As particular cases, we obtain an equivalent 
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criterion for strict differentiability of set-valued maps, and a relationship between 
calmness and Lipschitz continuity in both single-valued and set-valued maps. As 
far as we are aware, the relation between calmness and Lipschitz continuity in 
set- valued maps was first discussed in ^51 157] . 

2. Preliminaries and notation 

Throughout this paper, we shall assume that X and Y are Banach spaces. In 
most cases, we follow the notation of [JD]- Given two sets A,B C X , the notation 
A + B stands for the Minkowski sum of two sets, defined by 

A + B -.^ {a + b\ a e A,b e B}. 

The notation A — B is interpreted as ^ 4- i^B). We use (•, •) : X* x X — >• R, where 
{C,x) := C{x), to denote the usual dual relation. In Hilbert spaces (and hence in 
M"), (•, •) reduces to the usual inner product. The notation x — > x means that we 

take sequences {xi}^i C D such that limi^^ Xi = x. The closed ball with center 
X and radius r is denoted by M{x,r), while B denotes the closed unit ball. 

We say that the set-valued map S : X ^ Y is closed-valued if S{x) is closed 
for all X € X, and it is convex-valued if S{x) is convex for all x G X . A closed 
set-valued map is a map whose graph is closed. We say that C C X is a cone if 
e C and Ax e C for all A > and x e C. 

The graph of a set-valued map gph(S') C X x Y is the set {{x,y) \ y € S{x)}. 
The set-valued map : Y ^ X is defined by S~^{y) := {x \ y £ S{x)}, and 
gph(5-i) = {(y,x) I {x,y) G gpHS)}. 

Definition 2.1. A set-valued map T : X ^Y is positively homogeneous if 
T(0) is a cone, and T{kw) = kT{w) for all fc > and w £ X. 

It is clear that T is positively homogeneous if and only if gph(T) is a cone. If 
Ti,T2 : X ^ Y are two set-valued maps such that Ti{w) C T2{w) for all w £ X, 
then we write this property as Ti C T2. We denote the set- valued map T{—-) : 
X =^ y to be T(--)(w) := T{-w). 

We recall the definition of inner limits of a set valued map. 

Definition 2.2. When S : X ^ Y is a set-valued map, we say that 
limsupS'(a;) :~ {y £Y \ liminf = 0} 

is the outer limit of S* at x and 

liminf S'(a;) :^{yeY\ lim d{y, S{x)) = 0} 

x^x X — 

is the inner limit of S at x. When the outer and inner limits coincide, it is called 
the limit. 

The above definition of limits are equivalent to those in (40] by |401 Exercise 4.2]. 
We recall the definitions of outer and inner semicontinuity. 

Definition 2.3. For a closed-valued mapping S : X ^ Y and a point x G X: 

(1) S is upper semicontinuous at x if for any open set U such that S{x) C U , 
there is a neighborhood V oi x such that S{x) C U for all x G V . 

(2) S is outer semicontinuous at x if for any open set U such that S{x) C U and 
p > 0, there is a neighborhood V oix such that S{x)(^pB C U for all x £ V. 
Equivalently, S is outer semicontinuous at x if limsup^.^^ S{x) C S{x). 
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(3) S is inner semicontinuous at x if >S'(a;) C Xvcuvaix^x Six). 

(4) S is continuous at x if it is both outer and inner semicontinuous there. 

We caution that the terminology used to denote upper semicontinuity and outer 
semicontinuity is not consistent in the hterature. In finite dimensions, outer semi- 
continuity is equivalent to the notation in |40] (see [40^ Proposition 5.12]), where 
U is created by S{x) + eB. 

Outer semicontinuity is better suited to handle set-valued maps with unbounded 
value sets S{x). For example, the set- valued map S" : R =^ defined by 

S{e) {(t cos 61, t sin 61) | i > 0} 

(see [101 Figure 5-7] or [71 Page 27]) is not upper semicontinuous anywhere but is 
outer semicontinuous, and in fact continuous, everywhere. When S{x) is bounded, 
upper and outer semicontinuity are equivalent. We will not use upper semiconti- 
nuity in this paper. 

To simplify the notation, given any map T : X and constant (5 > 0, denote 
{T + 5) : X tohe the map 

{T + 5){w) ■-T{w) + 5\w\M. 

3. Generalized differentiability of single-valued maps 

The emphasis of this section is the generalized differentiability of single-valued 
maps / : X — > y. Much of the theory is already in [TH], but we concentrate on the 
key results that we will extend for the set-valued case in later sections. We now 
begin with our first definition of generalized differentiability. 

Definition 3.1. (T-differentiability) Let T : X ^Y he a. positively homogeneous 
set-valued map. We say that f : X ^ Y is T -differentiable at x if for any S > 0, 
there exists a neighborhood V of x such that 

fix) e f{x) + T{x -x) + S\x - x\M for all x e V. 

We say that f : X Y is strictly T -differentiable at x if for any S > 0, there exists 
a neighborhood ^ of a; such that 

fix) e fix') + T{x - x') ^ 5\x - x'\M for all x, x' € V. 

The map T : X zi^Y is referred to as a prederivative when / is T-differentiable, 
and as the strict prederivative when / is strictly T-differentiable in jl91 Definition 
9.1]. The definition of T-difFerentiability includes the familiar concepts of differen- 
tiability and Lipschitz continuity as special cases. 

Example 3.2. (Examples of T-differentiability) Let f : X ^ Y he a single-valued 
map. 

(1) When T : X ^ Y isa. (single- valued) continuous linear map, T-differentiability 
is precisely Frechet differentiability with derivative T, and strict T-differ- 
entiability is precisely strict differentiability with derivative T. 

(2) When T : X ^ Y is defined by T(k;) = k|w|B, T-differentiability is pre- 
cisely calmness with modulus k (i.e., \ fix)—fix)\ < a;|-|-o(|a;— a;|)), and 
strict T-differentiability is precisely local Lipschitz continuity with modulus 

K. 
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Strict T-differeiitiability is more robust than T-differentiability. The function 
/ : K ^ R defined by 

J sin(x^^) if a; 7^ 
'~ \0 ifa- = 

is Frechet differentiable at but not Lipschitz there. 

With the right choice of T, T-differentiabihty can also handle inequalities. 

Example 3.3. (Inequalities with T-differentiability) Let / : X — >■ R be a single- 
valued map. 

(1) / : X — >■ R is calm from below at x with modulus n, i.e., f{x) > /(x) — — 
x\ + o{\x — x\), if and only if / is T-differentiable there, where T : X ^M. 
is defined by T{w) = [— kI^I, oo). 

(2) The vector v € X* is a Frechet subgradient of f at x if and only if / is 
T-differentiable there, where T : X =^ R is defined by T{w) = [{v, w) , oo). 

(3) The convex set C C X* is a subset of the Frechet subdifferential of / at x 
if and only if / is T-difFerentiable there, where T : X =^ R is defined by 
T{w) = [sup^gc {v, w) , oo). 

It is clear from the definitions that if / is Ti-differentiable at x, and T2 satisfies 
T2 D Ti, then / is T2-differentiable at x as well. 

At this point, we mention connections to other notions of generalized deriva- 
tives for single- valued functions close to the definition of (strict) T-differentiability. 
Semidifferentiability, as is recorded in |401 Definition 7.20], can be traced back to 
|33j . and is equivalent to the case where T : X ^ Y is continuous and single- 
valued (see 1301 Section 9D]). Semidifferentiability for single- valued maps is not to 
be confused with semidifferentiability for set- valued maps defined in Definition STOI 

We now look at a slightly nontrivial example involving the Clarke subdifferential 

m. 

Definition 3.4. ]TU[ Section 2.1] (Clarke subdifferential) Let X be a Banach space. 
Suppose / : X — > R is locally Lipschitz around x. The Clarke generalized directional 
derivative of / at i in the direction v € X is defined by 

,0.- ^ f{x + tv)~f{x) 

f [x;v) = hmsup , 

where x Cz X and t is a positive scalar. The Clarke subdifferential of / at x, denoted 
by dcf{x), is the convex subset of the dual space X* given by 

{C e ^* I /°(x; v) > (C, v) for all v € X}. 

The Clarke subdifferential enjoys a mean value theorem. For C C X*, define the 
set {C,w) by {{c,w) \ c E C}. The following result is due to Lebourg [53], which 
has since been generalized in other ways. 

Theorem 3.5. |25| (Nonsmooth mean value theorem) Suppose Xi,X2 € X and f 
is Lipschitz on an open set containing the line segment [xi,X2]- Then there exists 
a point u G (xi, X2) such that 

f{x2) - f{xi) e {dcf{u),X2 - .Ti) . 

We show how the Clarke subdifferential relates to T-differentiability. For exten- 
sions and a more general treatment of the following result, we refer the reader to 
[H Sections 9, 10] 
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Theorem 3.6. (Clarke subdifferential and T -differentiability) Let f : X ^ R be a 
Lipschitz function, and C be a nonempty weak*- compact convex subset of X* . If f 
is strictly T -differ entiable at x, where T : X ^ M is defined by T{w) = {C,w), then 
dcf{x) C C. The converse holds if the map x dc f{x) is outer semicontinuous 
at X, which is the case when X ~ R". 

Proof. If / is strictly T-differentiable at x, then for any direction h ^ X, the Clarke 
directional derivative is 

max {v,h) = f°{x;h) 

,. f{x + th)-f{x) 
= limsup 

< max {v, h) . 

Suppose on the contrary that v' £ dcf{x)\C. Then there exists a direction h' and 
some a € R such that {v' , h') > a but maxugp {v, h') < a. This is a contradiction, 
which shows that dcf{x) C C. 

We now prove the converse. It is well-known that when X = M", the Clarke 
subdifferential mapping of a Lipschitz function is outer semicontinuous. See |40) 
for example. Suppose that dcfix) C C. By outer semicontinuity, given any S > 0, 
there is some e > such that dcf{x) C C + SM for all x S B(x,e). Theorem 13.51 
states that for any points xi,X2 G M(x, e), there is an x' e {xi,X2) such that 

f{xi) - f{x2) C {dcfix'), xi - X2) ■ 

This immediately implies that f{xi) G f{x2) + {C,xi — a;2) -l-(5|a;i — a;2|]B, and hence 
strict T-differentiability. □ 

It is well known that in finite dimensions, the Clarke subdifferential is the convex 
hull of the limit of gradients taken over where the function is differentiable. We 
now recall Rademacher's theorem. 

Theorem 3.7. (Rademacher's Theorem) Let O C M" be open, and let f : O ^ 
M'" be Lipschitz. Let D be the subset of O consisting of the points where F is 
differentiable. Then 0\D is a set of measure zero in M", In particular, D is dense 
in O, i.e., c\D D O. 

Closely related to the Clarke subdifferential is the Clarke Jacobian that was first 
introduced in [3]. 

Definition 3.8. (Clarke Jacobian) Let / : O ^ W" be Lipschitz, with O C M" 
open, and let 1^ C O consist of the points where / is differentiable. The Clarke 
Jacobian at x is defined by 

V/(i) := conv{A G M"^" : 3xi x with G D, Vf{xi) A}. 

It is clear from Rademacher's Theorem that the Clarke Jacobian is a nonempty, 
compact set of matrices. For m = 1, it is well-known that the Clarke Jacobian 
reduces to the Clarke subdifferential. The following result is equivalent to ]W[ 
Proposition 10.9], and is a generalization of a result that is well known for m = 1. 

Theorem 3.9. (Clarke Jacobian and T -differentiability) Let f : O —> R™ be Lip- 
schitz on an open set O C SJ^.At each x Cz O, f is T-differentiable at x, where 
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T -.W =t is defined by 



T{w) := {Aw I A e V/(x)}. 



Proof. In the case O — R", a useful equivalent condition for a set C C M" to be of 
measure zero is this: with respect to any vector w 7^ 0, C is of measure zero if and 
only if the set {r | x + tw G C} C M is of measure zero (in the one-dimensional 
sense) for all x outside a set of measure zero. Let D be the subset of O on which 
/ is differentiable. 

Fix w and let x G O and r > be such that [x, x + tw] D {0\D) has 
(one dimensional) measure zero. Then the function ip(t) = f(x + tw) is Lipschitz 
continuous for t e [0,r]. Lipschitz continuity guarantees that (/?(r) = (p{0) + 
Jq ip'(t)dt, and in this integral a negligible set of t values can be disregarded. Thus, 
the integral is unaffected if we concentrate on t values such that x + tw £ D, in 
which case (p'{t) — V f{x + tw){w). 



For any e > 0, we can consider a neighborhood O' of x so that whenever x S 
0'\D, then V/(a;) G V/(i) + el. We have 



The case where V f{x + tw) does not exist for all i in a set of nonzero measure can 
be treated easily by perturbing x. This establishes the T-differentiability of /. □ 

In Theorem 13. 9[ it is clear that there can be no closed convex valued positively 
homogeneous map T' C T such that / is T'-differentiable at x. 



In this section, we move on to define the generalized differentiability of set- 
valued maps and state some basic properties. Here is the first definition of the 
differentiability of a set-valued map. 

Definition 4.1. (T-differentiability) Let T : X he a. positively homogeneous 
set- valued map. 

(a) We say that S : X \s outer T -differentiable at x if for any (5 > 0, there 
exists a neighborhood V oi x such that 

S{x) C S{x) + T{x -x)+ 5\x - x|B for aU xgV. 

It is inner T- differentiable at x if the formula above is replaced by 

S{x) C S{x) - T{x -x)+ 5\x - x\M for aU x e V. 

It is T- differentiable at x if it is both outer T-differentiable and inner T-differentiable. 

(b) We say that S : X ^ Y is strictly T-differentiable at x if for any 5 > 0, there 
exists a neighborhood V of x such that 



f{x -\- tw) 



ip{T) 




C 



f{x)-{'T{Tw)+e\Tw\M. 



4. Generalized differentiability of set-valued maps 



S{x) C S{x') -t- T{x - x') + d\x - x'\M for all x, x' e V. 
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It is elementary that if : X =t F is a single-valued map S : X ^ Y, 
then the definitions of outer T-difFerentiability, inner T-differentiability and T- 
differentiability in Definition 14. If a) coincide. 

The case T{w) := k|i(;|]B. where k > is finite, is well studied in variational 
analysis. In the definitions of calmness and Lipschitz continuity below, we recall 
the notation for k commonly used in variational analysis. Calmness was first re- 
ferred to as "upper Lipschitzian" by Robinson j36) . who established this property 
for polyhedral mappings. 

Definition 4.2. (Calmness and Lipschitzness) (a) We say that S : X ^ Y is calm 
at X if there exists a neighborhood V x and k > such that 

S{x) C S{x) + k\x - x\M for all x e V. 

The infimum of all constants k is the calmness modulus, denoted by clmS'(a;). 
Calmness at x is equivalent to outer T-differentiability at x, where T : X ^ Y is 
defined by T{w) [clmS'(x)]|w|B. 

(b) We say that S : X ^Y is Lipschitz at x if there exists a neighborhood V of 
X and K > such that 

S{x) C S{x') + k\x - x'\M for all x, x' G V. 

The infimum of all constants k is the Lipschitz modulus, denoted by lip S{x). Lips- 
chitz continuity at x is equivalent to strict T-differentiability at x, where T : X ^ Y 
is defined by T(w) := [lip S'(x)]|u;|B. 

Consider the case where there is some k > such that T : X ^ Y satis- 
fies T{w) C k|k;|B for all w £ X. It follows straight from the definitions that if 
S : X ^ Y is outer T-differentiable and maps to compact sets, then it is outer 
semicontinuous. The same relations hold for inner T-differentiability and inner 
semicontinuity, and for T-differentiability and continuity. We remark that strict 
T-differentiability implies strict continuity in the sense of |401 Definition 9.28], but 
not vice versa. Their difference is analogous to the difference between upper semi- 
continuity and outer semicontinuity. 

We motivate this definition of set- valued differentiability with Proposition 14.41 
whose proof is straightforward. We now recall the Pompieu-Hausdorff distance. 

Definition 4.3. (Pompieu Hausdorff distance) For C,D C X closed and nonempty, 
the Pompieu-Hausdorff distance between C and D is the quantity 

d(C, D) inf {77 \ C d D + jyB, D d C + r;B}. 

The Pompieu-Hausdorff distance is a metric on compact subsets oi X. In fact, 
the motivation of calmness and Lipschitz continuity in Definition 14.21 comes from 
the Pompieu-Hausdorff distance. To motivate the definition of T-differentiability, 
we note the following result. 

Proposition 4.4. (Single-valued T -differentiability) Suppose S : X ^ Y is closed- 
valued. 

(1) Let T : X ^ Y be a single-valued map. Then S is T-differentiable at x if 
and only if for any 5 > Q, there is a neighborhood V of x such that 

d{S{x) + T{x - x), S{x)) < S\x - x\ for all x e V. 
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(2) Let T : X ^ Y be a single-valued map such that T ~ — T'(— •). Then 
S is strictly T -differ entiable at x if and only if for any 5 > Q, there is a 
neighborhood V of x such that 

d{S{x')+T{x-x'),S{x)) < S\x-x'\ for allx,x' G V. 

We now make a remark on the Pompieu-Hausdorff distance that is in the spirit 
of the main idea in this paper. 

Remark 4.5. (More precise measurement of sets) We can rewrite the Pompieu- 
Hausdorff distance as 

d(C, D) = M{ri \C cD + Ei,DcC + E2,EiC E2 C 

In certain situations, it might be useful to study sets Ei and E2 for which C C 
D + El and D C C + E2 instead of just taking them to be rjM. 

As is well-known in set-valued analysis, setting restrictions on the range gives a 
sharper analysis at the points of interest. We make the following definitions with 
this in mind. 

Definition 4.6. (Pseudo T-differentiability) Let S : X ^ Y he a set-valued map 
such that y £ S{x). 

(1) Let T : X ^ Y he a set-valued map. We say that S is pseudo outer T- 
differentiahle at x for y if for any 5 > 0, there exist neighborhoods V of x 
and W of y such that 

S{x) nW d S{x) + T{x - x) + 6\x - x\B for all x e V. 

It is pseudo inner T -differentiahle at x for y if 

S{x) nWc S{x) - T{x ~x)+ 5\x - x\B for all x € V. 

It is pseudo T -differentiahle at x for y if it is both pseudo outer T-differen- 
tiable and pseudo inner T-difFerentiable there. 

(2) Let T : X ^ Y he a. positively homogeneous set-valued map. We say that 
S is pseudo strictly T- differentiahle at x for y if for any S > 0, there exist 
neighborhoods V oi x and W oi y such that 

S{x) nW d S{x') + T{x - x') + 6\x - x'\M for aU x, x' e V. 

Again, the case T{w) :— k\w\M is of particular interest. The Aubin property was 
first introduced as pseudo-Lipschitzness in p[]. 

Definition 4.7. (Calmness and Aubin property) Let S : X ^Y he & set- valued 
map such that y S S{x). 

(1) We say that S is calm at x for y if there exist neighborhoods V oi x and 
W of y, and k > such that 

S{x) r\W C S{x) + k\x - x\M for aU x(^V. 

The infimum of all such constants k is the calmness modulus, denoted by 
clmS'(a; | y). Calmness is precisely pseudo outer T-differentiability, where 
T : a: =^ y is defined by T{w) := [clm5(i | y)]\w\M. 
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(2) We say that S : X ^ Y has the Auhin Property at x for y if there exist 
neighborhoods V oi x and W of y, and k > such that 



The infimum of all such constants k is the graphical modulus^ denoted by 
lipS'(x I y). The Aubin property is also known as the pseudo-Lipschitz 
property and as the Lipschitz-like property. The Aubin property is precisely 
pseudo strict T-differentiability, where T : X \& defined by T{w) := 

[lip5(x|y)]|«;|B. 

While the Clarke subdifferential is unique, the generalized derivative T need not 

be. 

Example 4.8. (Nonuniqueness and failure of intersections) Let 5 : R'^ ^ be 
defined by S{x, y) = {x] x M. Let Ti, Ta : _> ^2 defined by Ti(x, y) = (x, y) 
and T2{x,y) = (x,0). It is clear that S is (pseudo) strictly Ti-differentiable and 
(pseudo) strictly Ta-differentiable at all points, but it is not (pseudo) (Ti n T2)- 
differentiable anywhere. 

The positively homogeneous map T : R" ^ M™ defined from the Clarke Jacobian 
in Theorem 13.91 is defined as the union of linear functions, and thus satisfies T — 
— T(— •). In such a case T-differentiability implies — T(— •)-differentiability for single 
valued maps. But this need not be the case for set-valued maps. 

Example 4.9. (Failure of set-valued -T(--)-differentiability) Let 5 : M =t M be 
defined by S{x) :— (—00, x], and let T : R =t K be defined by 



Here, S is strictly T-differentiable at x for all a; e R, and it is pseudo strictly 
T-differentiable at x for x for all x e M. However, S is neither outer (or inner) 
— T(— •)-differentiable anywhere, nor pseudo outer (or inner) — r(— •)-differentiable 
at X for X for any 2; € R. 

We remark that while inner T-differentiability is defined so that Proposition 
14.41 holds, this definition of inner T-differentiability does not satisfy the property 
that strict T-differentiability implies inner T-differentiability in general. It ac- 
tually implies inner — T(— •)-differentiability. The same holds for pseudo strict T- 
differentiability and pseudo inner T-differentiability. or more correctly, pseudo inner 
— T(— •)-differentiability. An example where this occurs is the function 5 : R ^ M 
as defined in Example 14.91 Fortunately, inner T-differentiability does not play a 
huge role in this paper. 

Much of the current methods for set-valued differentiation are motivated by look- 
ing at the tangent cones of the graph of the set- valued map. See the discussion in 
[H Chapter 5] on the different forms of set- valued differentiation obtained by taking 
different kinds of tangent cones of the graph. The notions of semidifferentiability 
|34j and proto-differentiability [321 are based on this idea. We recall the definitions 
of semidifferentiability and proto-differentiability from |40[ Page 331- 332]. See also 
the techniques in [H Chapter 5]. We now point out the lack of relation between 
pseudo T-differentiability and these methods by observing the finite dimensional 
case. 



S{x) nW d S{x') + k\x - x'\B for all x, x' e V. 




{0} ff w < 

[— ui, w\ if It; > 0. 
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Definition 4.10. [Sj (SemidifFerentiability) For a set-valued map 5* : M" =| R", 

let X e doni(S'), y € S{x) and w eW\ If the limit 

S(x + Tw) — y 
lim 

exists, then we say that it is the semiderivative at x for y and w. If the semideriva- 
tive exists for every vector id £ R", then S is semidifferentiable at x for y with 
derivative DS{x \ y) : R" =4 R™ defined by DS{x \ y){w) being equal to the limit 
defined above. 

Definition 4.11. j39] (Proto-differentiabihty) A mapping 5* : R" ^ M™ is said to 
be proto-differentiable at x for an element y G S{x) if 

I ,. S{x + Tiv)~y 
Db(x I y)(w) = hmsup 

and there exist for each z £ DS{x \ u){w) and choice of \ sequences 
Wi ^ w and — > z with Zi G + TiWi) — y]/Ti. 

For this paper, it is sufficient to note that semidifferentiability implies proto- 
differentiability through gOl Exercise 8.43 (a)(d)]. 

The definition of semidifferentiability for set-valued maps is not to be confused 
with the semidifferentiability defined for single- valued maps before Definition 13.41 
Clearly, the limits in the definitions above are cones, and the derivative DS{x \ y) 
are both positively homogeneous maps. We present an example where S" : R ^ R^ 
is not pseudo strictly DS{x \ y)-differentiable at x for y. 

Example 4.12. (Semidifferentiability and T-differentiability 1) Consider the set- 
valued map S* : M =t defined by 

i{it,v^)\-x<t<0}u{{x}x[y^,oD)) ifa;<0 
^ I < t < a;}U ({x} X [Vi,oo)) if x > 0. 

This map is semidifferentiable at for 0, with semiderivative DS{0 | 0) : R =^ R^ 
defined by DS{0 \ 0)(w) = {0} x [0, oo) for all w G M. However, S is not pseudo 
strictly DS{0 \ 0)-differentiable at for 0, because at any point (0, a) £ {0}x (0, oo), 
we can find a neighborhood Ua of (0,a) such that S{x) D Ua is [{x} x (—00,00)] n 
Ua- See Figure 14.11 Since semidifferentiable functions are proto-differentiable, 
this example also shows the lack of relation between proto-differentiability and T- 
differentiability. 

One may expect that if S is T-differentiable at x for y, then DS{x \ y) C T. The 
following example shows that this is not the case. 

Example 4.13. (Semidifferentiability and T-differentiability 2) Consider S* : R ^ 
R defined by S{x) ~ R. Clearly S is pseudo T-differentiable at x for any ?/ G R, 
where T : R — >■ R is defined by T{w) ~ for all w G R. But the semiderivative 
DS{x I y) : R ^ R, or equivalently the proto-derivative, is equal to S, which gives 
DS{x I y) T for aU x, y G R. 



12 



C.H. JEFFREY PANG 




S{-e) 
SiO) 
Sie) 
S{2e) 



Figure 4.1. In Example l4.12[ for any a > 0, we can find a neigh- 
borhood Ua of tlie point (0, a) such that the map 5 : M =4 
satisfies S{x) CiUa ~ [{x} x (— oo, oo)] n Ua- 



5. Calculus of T-differentiability 



In this section, we prove a chain rule and a sum rule similar to the coderivative 
calculus in [401 Section lOH], which was first studied in (31]. Let us first introduce 
the outer norm of a positively homogeneous set-valued map. 

Definition 5.1. (Outer norm) U T : X ^ Y is a. positively homogeneous map, 
then the outer norm of T is 



Clearly |r|+ < oo implies T(0) = {0}. When r(0) = {0}, |r|+ = clmT(0 | 0) = 
clmT(O). 

Here is a chain rule for T-differentiable functions. In the statements of the 
results in this section, the positively homogeneous map T^^y refers to a generalized 
derivative that arises from considering the point y e F{x). Other such maps T are 
similarly defined. 

Theorem 5.2. (Chain rule) Let F : X ^ Y , G : Y z=t Z , and z e G o F{x). 
Suppose the following conditions hold 

(1) F is pseudo outer T^-^y-differentiahle at x for y for ally in G~^{z)nF{x). 

(2) G is pseudo strictly Ty^z-differentiable at y for z for all y in G^^{z)C\F(x). 

(3) The set G^^{z) H F(x) <ZY is compact. 

(4) The map (.t,z) i— > G^^{z) H F{x) is outer semicontinuous at (x, z). 

(5) a supygc.-i(2)ni^(2) l^x^yl'^ is finite. 

(6) For all y G G~^{z) f) F{x), Ty^z{0) = {0}, and j3 is finite, where 



\T\ 



+ 



sup sup |y| = sup{|?;| I y e T(2;), |a;| < 1}. 



x\<ly£T(x) 



/3: 



sup 

yeG-^{z)r\F(x) 



lipTy^2(0). 
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Then G o F is pseudo outer T-differentiable at x for z, where T : X ^ Z is defined 
by 

(5.1) T:= y Ty^,oT,^y. 

yeG-'^(z)r\F(x) 

The function GoF is pseudo strictly T-differentiable for T : X defined in (|5.ip 

if in statement (1), F were pseudo strictly Tg^y-differentiable at x for y instead. 

Proof. We shall prove only the result for F being pseudo outer T-differentiable. 
The proof for pseudo strict T-difFerentiability is almost exactly the same. Choose 
any (5 > 0. Since (2) holds, for each y S G~^{z) D F{x), we can find some open 
convex neighborhoods Vy of y and W of z such that 

G(y') n C G{y") + Ty^,{y' - y") + S\y' - y"\M for all y' , y" G V^. 

Next, since (1) holds, for each y £ G~'^{z) n F{x), we can find open convex neigh- 
borhoods U oi X and Vy C Vy of y such that 

F{x) nVyC [{F{x) n Vy) + Ts,^y{x ~x)+ 5\x - i|B] n Vy for all xeU. 

Since G~^{z) n F{x) is compact by (3), there are finitely many j/^ G G~^{z) n F{x) 
such that G-^{z)r\F{x) C Vyi- By taking finitely many intersections if necessary, 
the neighborhoods U and W can be assumed to be independent of 

Let V := IJj Vy^. Since the map (x, z) G~^[z) fl F{x) is outer semicontinuous 
at (x, z) by (4), we can reduce U and W if necessary so that G~^(W^) H F{U) C V. 
This implies that for any x £ U, 

G{F{x)) nw = G{F{x) nv)nw 

= (^G{Fix)nVy^)^nw. 

We have 

G(F(x) n FyJ n 
c G([(F(i) n V^J + Ts^y^ {x-x) + S\x - x\M] r\Vy,)nw 

(5.2) C G{F{x)nV^^) +Ty,-,,{Ts^y^{x-x) + S\x-x\m) 



S\Ts^y,{x -x) + 6\ 



X 



C Go F{x) + Ty^^g o Ts-^y,{x -x) + S/3\x - x|B + S{a + 5)\x - x|B 

= Go F(i) + Ty^^g o Ts^y^ (x - i) + (5(a + + (5)|a; - x\B. 

We may assume that 6 is small enough so that a + /3 + 6 is bounded from above by 
some finite constant 6. Choosing y^ over all i gives 

\jG{F{x)nVy^)nw 



C GoFix)+ (^Ty^^,oT^^y^{x~x)j +5e\: 
C G o F{x) + U Ty..^ o T^^yix - : 

\yeG-Hz)nF(x) 

This completes the proof of the theorem. □ 
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In Theorem 15.21 we require G : Y ^ Z to he pseudo strictly T-differentiable for 
the appropriate T : Y ^ Z. li G : Y ^ Z were pseudo outer T-differentiable, then 
we can still obtain a result for the case where F : X ^ Y is single- valued. 

Proposition 5.3. (Chain rule) Let f : X ^ Y and G : Y ^ Z, y = f{x), and 
z e G{y). Suppose the following conditions hold 

(1) / is Tx-s,y-differentiahle at x for y. 

(2) G is pseudo outer Ty^g-differentiable at y for z. 

(3) |r2_i..y|^ is finite. 

(4) Ty_,g{0) ^ {0}, and\ipTy^g{0) is finite. 

Then G o f is pseudo outer T-differentiable at x for z, where T : X ^ Z is defined 
byT^ Ty^z o Ts^y. 

Proof. Choose some 5 > {). By condition (1), we can find a neighborhood U oi x 
such that 

f{x) e f{x) + Ts,^y{x -x) + 5\x - x\& for aU x e U. 

Let V be such that f{x) + Ts^y{x - x) + S\x - x\B d V for aU x €17. By (2), we 
can shrink U and V if necessary so that there is a neighborhood W z such that 

G{y) nWc G{y) + Ty^,{y - y) + S\y - y\M for aU y e V. 

A calculation similar to (|5.2p concludes the proof. □ 

From the chain rule, we can infer a sum rule. 

Corollary 5.4. (Sum rule) Let Si : X ^ Y for i — 1, . . . ,p, and y G Si{x). 
Define F : X ^ YP by Fix) = iSi{x), Sp{x)), and define g : YP Y to be 
the linear map mapping to the sum of the p elements in YP . Suppose the following 
conditions hold. 

(1) Si is pseudo outer T^^y, -differentiable at x for yi whenever yi £ Si{x) and 

yi + — ^yp = y- 

(2) The set {{yi,..., y^) \ yi € Si{x), yi -\ h j/p = y} C is compact. 

(3) The map {x,y) i— >■ g~^{y) H F{x) is outer semicontinuous at {x,y). 

(4) ai := sup^^gniO-i(z)nF(2)) l^s^yj for each i ^ l,...,p. Here, 
Hi : YP — > y is the projection onto the ith coordinate. 

Then g o F : X ^ Y , which is the sum of the maps Si, is T-differentiable at x for 
y, where T : X ^ Y is defined by 

(5-3) T:= U (e^^-..)- 

yi + ■■■ + Vp = v ^ ' ' 

yi e Si{x) 

The function go F is pseudo strictly T-differentiable for T : X ^ Y defined in (|5.3p 
if in statement (1), Si were pseudo strictly T^_^y, -differentiable at x for yi instead. 

Proof. For y, e Si{x) for all i, define T(y^ : X ^YP hy 

Condition (1) implies that the map F is pseudo outer r(j^j^^ j^p) -differentiable at x 
for (yi, . . . , yp). We now proceed to apply the chain rule in Theorem l5.2l Since g is 
a linear function, the conditions for g needed for the chain rule are satisfied. The 
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rest of the conditions in this result are just the appropriate conditions in the chain 
rule rephrased. The case of pseudo strict T-differentiability is similar. □ 

Note that we have focused on pseudo (outer/ strict) T-differentiability so far in 
this section. The relation between pseudo (strict/ outer/ inner) T-differentiability 
and (strict/ outer/ inner) T-differentiability is illustrated by the following theorem. 
We say that S : X ^ Y is locally compact around x G dom(T') if there is a 
neighborhood O of x and a compact set C C Y such that S{0) C C. 

Theorem 5.5. (T -differentiability from pseudo T-differentiability) Let S : D ^ Y 
be a closed-valued outer semicontinuous map on a closed domain D <Z X . Suppose 
S is locally compact around x ^ D. Then S is outer T -differentiable at x if and 
only if S is pseudo outer T -differentiable at x for all y e S{x). 

An analogous statement holds for (strict/ inner) T-differentiability and pseudo 
(strict/ inner) T-differentiability. 

Remark 5.6. In fact, the hypothesis of outer semicontinuity in Theorem 15.51 can 
be weakened: We can assume that S is closed at x: For every y ^ S{x), there are 
neighborhoods U oi x and V oi y such that S{x) DV = ^ for all x £ U. If 5 is outer 
semicontinuous, then gph(5) is closed by [4j Proposition 1.4.8], which implies that 
S is closed at x. The proof of Theorem 15.51 can be easily adapted from the proof of 
[32^ Theorem 1.42], which traces its roots in the finite dimensional case to |38) . 

Other calculus rules that are important are the Cartesian product of set- valued 
maps, and rules for unions. These two operations are simple to formulate and 
prove. For intersections of set-valued maps, we feel it is more effective to look at 
the normal cones of the intersections of the graph of the appropriate functions and 
apply the Mordukhovich criterion. See Section El We close this section by referring 
the reader to |38j for more applications of set-valued chain rules. 

6. The Mordukhovich criterion 

As we have seen in Section 21 the Aubin property gives a sharper analysis for 
the Lipschitz continuity of set-valued maps. An effective tool for calculating the 
graphical modulus (for the Aubin property) is the coderivative defined in Defintion 
16.21 which is a generalization of the adjoint linear operator of linear functions. 
Coderivatives enjoy an effective calculus, and can be easily calculated for set- valued 
maps whose graphs are defined by smooth maps. The relationship between the 
Aubin property and the coderivatives is referred to as the Mordukhovich criterion in 
[40j . For a history of the Mordukhovich criterion, see the bibliography in [40] , which 
in turn cited [12l|20l|24l|29l|42] , and also Commentaries 1.4.6-1.4.9, 4.5.2 and 4.5.6 
of [32] . The aim of this section is to show that coderivatives in fact give directional 
behavior that is captured in the language of pseudo strict T-differentiability. 

We now recall the classical definition of the normal cones and coderivatives in 
finite dimensions, which were first introduced in |27j and [28] respectively. 

Definition 6.1. [27] (Normals) Let C C K" and x G C. A vector v is normal to 
C at X in the regular sense, or a regular normal, written v S Nc{x), if 

{v, X — x) < o{\x — x\) for a; e C. 

It is normal to C at x in the general sense, or simply a normal vector, written 
V € Nc{x), if there are sequences Xi — > x and Vi — > v with Vi e Nc{xi). 
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Definition 6.2. [28] (Coderivatives) Consider a mapping S : M" =t M™, a point 
X g doin(S') and y € S{x). The coderivative at x for y is the mapping D*S{x \ y) : 
M" =^ M" defined by 

■y g i:>*S'(S I y)(z) -4=^ {v,-z) e Ng^p^s){x,y)- 

In the case where 5* is a smooth map, the coderivative D*S{x \ S{x)) is the 
adjoint of the derivative mapping tliere. 

Next, we recall the definition of the regular subdifFerential and general subdif- 
ferential, which are important in the proof in the main result of this section. 

Definition 6.3. (SubdifFerentials) Consider a function / : R" — > R and a point 

X e M" . For a vector u e R", 

(a) w is a regular subgradient of / at x, written v G df{x), if 

f{x) > f{x) + {v,x-x) + o{\x -x\); 

(b) w is a (general) subgradient of / at x, written v G df{x), if there are 
sequences Xi x and Vi g df{xi) with Vi — > v and f{xi) — !■ f{x). 

(c) The sets df{x) and df{x) are the regular subdifferential (or Frechet sub- 
gradient) and the (general) subdifferential (or limiting subdifferential, or 
Mordukhovich subdifferential) at x respectively. 

We now present our main result of this section. 

Theorem 6.4. (Mordukhovich criterion revisited) Consider S : M" =^ R"\ a; g 
dom(S') and y g S'(a;). Suppose gph(S') is locally closed at {x,y). If D*S{x \ 
y)(0) = {0}, or equivalently, \D*S{x \ y)\^ < oo, then S is pseudo strictly T- 
differentiable at x for y, where T : R" ^ R™ is defined by 

T{w) = k{w)M"', 

where k : R" — > R_|^ is defined by 

k{w) := max{{-v,w) \ v g D*S{x \ y)(B™)} 

= max{{-v,w) I {v,-z) g iVgph(s)(5, y) for some \z\ < l} . 

The assumptions of Theorem 16.41 are the same as that of the Mordukhovich 
Criterion as stated in [301 Theorem 9.40]. The Mordukhovich criterion estab- 
lishes the equivalence between the Aubin property (with graphical modulus k* :~ 
max|^„l<]^ «;(?«)) and the outer norm of the coderivative. Theorem 16.41 shows that 
the worst case Lipschitzian behavior need not occur in all directions. 

Proof, (of Theorem l6.4p We highlight only the parts we need to add to the proof of 
sufficiency as given in |401 Theorem 9.40], though with some changes to the variable 
names. Let R = \D*S{x \ y)\^ . By the definition of H and the coderivatives, for 
any 6 > 0, there exists Sq > and eo > for which 

Ngph(s){x,y) n (R" X 1") C (k + 6*)!" X B" for aU x g M{x,So),y e M{y,eo). 

(The above statement is just [40l 9(22)] rephrased.) The mapping to normal cones 
is outer semicontinuous, so 

(a 1 ^ ^spMS) : y) n [(S + 0)B" X B"] C 7Vgph(s) ix,y)+ 

^ ' for ah X g B(x, So), y £ B(y, eo)- 
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Define the map dy{x) : R" — > R by dy{x) := d{y, S{x)). In their proof, the condition 
in 9(23)] can be written more precisely as: 

{if V e ddy{x) with |x — a;| < 5q 
and dy {x) + \y~y\< eg, then 
there exists z G B with (w, —z) G -^gph(S)(ii y)5 

where y is any point of S{x) nearest to y, that is |t/ — = dy{x). Moving on, they 
proved that the map (.t, y) diij, S{x)) is Lipschitz continuous near (x, y), or more 
precisely, there exists some A > and ^ > such that 

(6.3) d{y, S{x)) < X{\x ~ x\ + \y — y\) when |x — a;| < /i and \y ~ y\ < /i. 

Furnished with this, we can choose S > and e > small enough that 26 < 
min{/i, Sq}, e < min{/i, eo/2} and X(2S + e) < eo/2. If f € ddy{x), \x — x\ < 25 and 
|y ~ y| < then by (|6.3p . we have 

ds(i) < A(|i - x| + |y - y|) < \{25 + e) < |. 

Formula (|6.2p then tells us that for any v e ddy{x), there exists some z e B such 
that {v, -z) e 7Vgph(s)(i,y). 

By (|6.ip . there is some (w,— z) G -/Vgph(s)(x, y) such that |(z;,— z) — {v,~z) \ <9. 
This gives V e L»*S(x | i/)((l + 6')B™), or e D*Six \ y)(B'"). Further 

arithmetic gives \v-j^v\ < \v~t'\ + \j^v\ < 6(1 + jfg), so v e D*S{x \ y)(B™) + 
61(1 + jfgW- Let 9 be 61(1 + -^). We thus have ddy{x) C i:'*5(x | y)(B) + OT. 
The function dy{-) is Lipschitz, so the Clarke subdifferential equals conv{ddy{-)) in 
B(y,e). 

Choose any two points x,x' G B(.t,(5). By the nonsmooth mean value theorem 
(Theorem 13. 5p . we have dy{x) — dy{x') = {v,x — x') for some v € dcdy{x^) ~ 
conv(9(iy (xt-)), where x^ ~ tx + [1 ~ t)x' for some r G (0, 1). Now, 

{v,x — x') < iTia.x{(v,x — x') \ V ^ dcdy{xr)} 

< max{{ij,x~ x) \d e D*Six\u)(M) +m} 
= k{x' - x) +9\x' ~ x\. 

This can be rephrased as dy{x') > dy{x) — nix' x) — 9\x' ~ x\. As y varies over all 
points inB(y,e), this readily gives S'(x') nB(y, e) C S{x) + T{x' - x) + 9\x' ~ x\M"\ 
which is what we seek to prove. □ 

Rockafellar [3S] established the relationship between the Aubin property of S at 
X for y and the Lipschitz continuity properties of dy{-). (See [301 Exercise 9.37].) 
The key to the proof of Theorem 16.41 is that the nonsmooth mean value theorem 
on dy{-) gives us more information on the continuity properties of S. 

We close this section with a remark on Theorem 16.41 

Remark 6.5. (More precise T-differentiability) Suppose S : R" =| R'", and y G 
S{x). To obtain a better positively homogeneous map T : R" =t R™ than the one 
stated in Theorem 16. 4[ one applies Theorem 16.41 on the map g o S + f : R" =$ R™, 
where / : R" — > R™ and g : R™ R™ are linear maps and g is invertible. This 
approach is equivalent to looking at the normal cones of gph(g o S + f), which 
can also be obtained by performing the linear map {x,y) i— >■ {x,g{y) + f{x)) on 
gph(5') C R" X R™. By appealing to the calculus rules in Section |5j this gives 
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another T : M" =t M'" for which S is pseudo strictly T-differentiable. If we choose 
finitely many {(/j,^^)},, then we can define T' : M" =^ R" by 

T'{w) ~ Ti{w), where i is determined uniquely by w. 

It is easy to see that S is T'-diiTerentiable at x for y. 

For a semialgebraic set- valued map S : X ^ R™, where X C K" (i.e., a set- 
valued map whose graph in R" x M™ is a finite union of sets defined by finitely many 
polynomial inequalities), the approach in Remark 16.51 was used in |TT] to prove that 
for all X £ X outside a set of smaller dimension than X, given any y G S{x), we 
can find a linear map T : R" M™ such that S is pseudo strictly T-difFerentiable 
at X for y. Note however, as illustrated in Example 14.81 that the linear map may 
not be unique. 

7. Metric regularity and open covering 

For S : X ^ Y, it is well known that the Aubin property of S^^ is related to 
the metric regularity and open covering properties of S. In this section, we study 
metric regularity and open covering in a more axiomatic manner with the help of 
T-difFerentiability, proving new relations in these subjects. We caution that for 
much of this section, we need T :Y ^ X instead oi T : X ^ Y. 

We begin with our definitions of generalized metric regularity and open covering. 

Definition 7.1. (T-metric regularity) Let X and Y be Banach spaces, S : X ^Y 
be a set-valued map and T : Y ^ X he positively homogeneous. We say that 5* is 
T -metrically regular at {x^y) G gph(S') if for any 5 > 0, there exist neighborhoods 
V oix and W oiy and r > such that, for any x and A C rB, (or equivalently, 
for any set A C rB containing exactly one element), 

(7.1) y e [S{x) +A]r\W implies x G S~^{y) + (T + 5){A). 

Definition 7.2. (T-open covering)Let X and Y be Banach spaces, S : X ^ Y 
be a set-valued map and T : Y ^ X he positively homogeneous. 5* is a T-open 
covering at {x,y) £ gph(S') if for any 6 > 0, there exist neighborhoods V oi x and 
W of y and r > such that, for any x £ V and any set A C rM (or equivalently, 
for any set A C rM containing exactly one element), 

(7.2) [S{x)+A]nWcS{x+{T + S){A)). 

Open covering is sometimes known as linear openness. Setting T{w) := k|w|B 
in both cases reduce the above definitions to the classical definitions of metric 
regularity and open covering with modulus n. Metric regularity with modulus k is 
often written compactly as: For all k' > k, there exists neighborhoods of a; and 
W oi y such that 

xeV,yeW implies d{x, S~'^{y)) < K'd{y, S{x)). 

We have our following theorem generalizing the classical equivalence of pseudo 
strict T-differentiability, T-metric regularity and T-open covering. 

Theorem 7.3. (T-metric regularity and T -openness) Let X and Y be Banach 
spaces and T : Y ^ X be a positively homogeneous map. For S : X ^ Y , the 
following are equivalent: 

(MR) S is T(—-)-metric regular at {x,y) G gph(5). 

(OC) S is a {—T{—-))-open covering at (x, y) G gph(S'). 
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(IT) S^^ is pseudo strictly T -differentiable at y for x. 

Proof. We first note that x e S^^{y') D V can be rewritten a.s x £ V , y' £ S{x), so 
(IT) is equivalent to: For any S > 0, we can find neigliborhoods V oi x and W of 
y sucli that 

(7.3) x_£_V, y' £ S{x),y £W,y' £W implies x £ S'^jy) + { T + 6){y' - y) . 

(1) (2) (3) (4) (5) 

Next, take the set A to he A = {y - y'}. The condition y £ [S{x) + A] n W is 
equivalent to (2) and (3). The definition of r(— •)-metric regularity can be written 
as: For any 6 > 0, we can find a neighborhood V oi x and r > such that 

(7.4) x£V,y' £ S{x), y £ B(y, r) and A C B(0, r) 
implies x£S~\y) + {T + S){-A). 

^ V ' 

(5) 

We first show that (IT) implies (MR). Suppose dLS]) holds for W = M{y,r'). If 
r = ^, then y £ M{y,r) and A C 1(0, r) implies that y' £ B(j/, 2r) = M{y, |r'). 
Therefore the formula in ()7.4|) holds for r = y. 

Next, we show that (MR) implies (IT). Suppose (HH) holds. If y' £ M{y, §) and 
y £ B(j/, §), then y - y' £ B(0,r), or A C B(0,r). This means that holds for 

H^ = B(y,i). 

For the equivalence of (OC) and (MR), note that (OC) is equivalent to modifying 
the formula (5) in (|7.4p to the equivalent condition y £ S{x — (T + 5){y' — y)). □ 

We now look at the connection between pseudo T-outer differentiability and 
metric subregularity. For more on metric subregularity, we refer the reader to |13| . 
We define T-metric subregularity as follows. 

Definition 7.4. (T-metric subregularity) Let X and Y be Banach spaces, S : 
X he & set-valued map, and T -.Y ^ X he positively homogeneous. S is T- 
metrically subregular at (x, y) £ gph(S') if for any S > 0, there exists a neighborhood 
V of X and r > such that, for any A C rM, (or equivalently, for any set A C rM 
containing exactly one element.) 

(7.5) x£V,y£ 5 (x) -I- A implies x £ S'^iy) + {T + 5){A). 

Again, the special case of T{w) := KluijB, T-metric subregularity is equivalent 
to metric subregularity with modulus k, and can be written compactly as: For any 
k' > K, there exists a neighborhood V oi x such that 

x£V implies d{x,S~\y)) < K'd{y,S{x)). 

Here is a result on the equivalences between T-metric subregularity and pseudo 
outer T-differentiability. 

Theorem 7.5. (Generalized metric subregularity) Let X andY be Banach spaces, 
S : X ^ Y be a set-valued map, and T : Y ^ X be a positively homogeneous 
set-valued map. The following are equivalent: 

(MR') S is T{—-)-metric subregular at {x,y) £ gph(S'). 
(IT') S^^ is pseudo outer T- differentiable at y for x. 
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Proof. Condition (IT') can be written as: For any S > 0, there exists a neighbor- 
hood V of X and r > such that 

(7.6) xeV,xe S~\y'),y' - y G rl imphes x e S'^y) + (T + 5){y' - y). 

It is also clear that (MR') can be written in this form with A ^ {y — y'}. □ 

Here is a lemma on pseudo strict T-differentiability amended from [401 Lemma 
9.39], which is in turn attributed to |16j . 

Lemma 7.6. (Extended formulation of pseudo T-differentiability) Consider a map- 
ping S : X ^ Y , a pair (x, y) € gph(S') where gph(S') is locally closed, a set D <Z X 
containing x, and a positively homogeneous map T : X . Suppose that there is 
a (5 > such that 

(7.7) T{w) D 5\w\M for all w e X. 

Then the following two conditions are equivalent: 

(a) there exist neighborhoods V of x and W of y such that 

S{x') nW C Six) + T{x' - x) for all x,x' e DnV. 

(b) there exist neighborhoods V of x and W of y such that 

S{x') nW d Six) + T{x' - x) for allxe DnV, x' G D. 

The following two conditions are equivalent as well. 

(a') there exist neighborhoods V of x and W of y such that 

S{x') nW C S{x) + T{x' - x) for all x' <^Dr\V. 

(b') there exists a neighborhood W of y such that 

S{x') r\W C S{x) + T{x' - x) for all x' S D. 

Proof. Trivially (b) implies (a), so assume that (a) holds for neighborhoods V = 
B(x,7) and W = B(y,e). We wiU verify that (b) holds for V = IB(i,7') and 
W = B(y, e') when < 7' < 7, < e' < e, and 25i + e' < ^7. 
Fix any x & D f] B(i, 7'). Our assumption gives us 

S{x') n B(y, e') C S{x) + T{x' - x) when x' e D C^ B(x, 7'), 

and our goal is to demonstrate that this holds also when x' € Z?\B(a;,7). From 
applying (a) to x' = x, we see that y G S{x) -\~T(x~x) and consequently B(y, e') C 
S'(a;)+((57'+e')B, where S-f'+e' < S-f-S-f'. But \x'~x\ > 7-7' when x' G D\B(:e,7), 
so for such points x' we have ^7 — 6^ < 6\x' — x\. Hence 

S{x') n B(y, e') C S{x) + S\x' - a;|B C S{x) + T{x' - x) 

as required. 

We now look at the equivalences of (a') and (b'). Trivially (b') implies (a'), so 
assume that (a') holds for neighborhoods V = M{x,'-f) and W = M{y,e). We can 
reduce e so that e < Sj. Then x' G D\B{x, 7) implies W C S{x) + T{x' - x), which 
gives us what we seek. □ 

If T^^(O) ~ Y, we have the following equivalent definitions for T-metric regu- 
larity. T-open covering and T-metric subregularity that do not require A C rM. 
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Proposition 7.7. (Alternate definition of metric (sub) regularity and openness) Let 
S : X ^ Y and T : Y ^ X be set-valued maps, with T positively homogeneous 
and T~^(0) = Y. The following is equivalent to the T-metric regularity of S at 
ix,y) G gph(S'); 

(MRi) For any S > 0, there exist neighborhoods V of x and W of y such that, 
for any x (1 V and A <ZY , (or equivalently, for any set A <zY containing 
exactly one element), 

y e [S{x)+A] n W implies x e S-^{y) + {T + S){A). 

The following is equivalent to the T-open covering of S at {x,y) G gpli(S'); 

(OCi) For any S > 0, there exist neighborhoods V of x and W of y such that, 
for any x (1 V and any set Ac Y (or equivalently, for any set A C Y 
containing exactly one element), 

[S{x) +A]r\WcS{x+{T + S){A)) . 

The following is equivalent to the T-metric suhregularity of S at {x,y) G gph(5); 

(MR']^) For any S > 0, there exists a neighborhood V of x such that, for any x Cz V 
and A G Y , (or equivalently, for any set A G Y containing exactly one 
element) 

y e S{x) + A implies x e S~^{y) + {T + 6){A). 

Proof. The condition r^^(O) = Y ensures that Lemma [7.61 apphes. Pseudo strict 
T-differentiabihty of at y for x is equivalent to: For any S > 0, there exists 
neighborhoods V oi x and W y such that 

(7.8) x_G^,y' G Six),y_eVV =^ x e S-\y) + {T + S){y' ~ y^ 

(1) (2) (3) (5) 

The difference here from (|7.3p is that the condition y' £ W is superfluous due to 
Lemma [7.61 We also note that r(— •)-metric regularity is rewriting (2) and (3) as 
y G [S{x) + {y — y')] n W in the above, while — r(— •)-open covering is rewriting (2) 
and (3) asj/ G [S{x) + {y - y')]r]W and (5) as y & S{x- {T + S)iy' -y)). Combined 
with Theorem l7.31 this proves the alternative definitions of T-metric regularity and 
T-open covering in (MRi) and (OCi). 

For the equivalence of T-metric suhregularity and (MR'j^ ) . the proof is similar. □ 

We now introduce the definition of {C, T)-metric regularity and (C, T)-open cov- 
ering. 

Definition 7.8. {{C,T)- regularity and covering) Let X and Y be Banach spaces, 
S : X ^ Y he a. set- valued map, T : y =^ X be positively homogeneous, and 
C C y is closed. 

(a) S is (C, T)-metrically regular at (x, y) G gph(S') if for any (5 > 0, there exist 
neighborhoods V oi x and W oi y and r > such that, for any x & V and 
t > 0, 

y G [Six) + tC]nW implies x G S-\y) + (T + 6){tC) 
for all t such that tC G rM. 
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(b) 5 is a {C,T)-open covering at {x,y) G gph(5) if for any (5 > 0, there exist 
neighborhoods V oi x and W of y such that, for any x V and t > 0, 

[S{x) + tC]r\W C S{x +{T + 6){tC)) 

for all t such that tC C rB. 

One might choose C to be a set different from the unit ball B, as this allows one 
to identify sensitive and less sensitive directions. For example one can choose C as 
the unit ball under a different norm. 

We prove the equivalence of (C, T)-metric regularity and T'-metric regularity 
for some T' : F =| X. A similar equivalence also holds for (C, T)-open coverings. 
Therefore one needs only to look at T- metric regularity and T-open coverings. 

Proposition 7.9. (Reduction of (C,T) -metric regularity to T-metric regularity) 
Let X and Y be Banach spaces, S : X ^ Y be a set-valued map, and T : Y ^ X 
be positively homogeneous. Then S is T' -metrically regular at {x,y) implies that S 
is [C ,T) -metrically regular there, where T' : Y ^ X is defined by T'{w) = T{tC) 
for t = min{A | w £ AC}. The converse holds if eM d C G RM for some e, R > 0. 

Proof. We recall from the proof of Theorem 17.31 T'-metric regularity is equivalent 
to: For all S > 0, there is a neighborhood V of x and r > such that 

(7.9) X eV,y'e Six), ye Miy,r),y-y' e rM implies x e S-\y) + {r + d)iy-y'). 

Next, we note that (C, T)-metric regularity is equivalent to: For any 6 > 0, there 
is a neighborhood V of x and r > such that 

xeV,ye [Six) + tC]nM{y,r),tC C rM implies x € S'"^(y) + (T + (5)(tC), 

which is in turn equivalent to: For any 5 > 0, there is a neighborhood V of x and 
r > such that 

(7.10) xeV,y' e Six),y e Miy, r), y - y' e tC, tC C rl 

implies xeS-\y) + iT + S)itC). 

Suppose S is r'-metrically regular at ix,y). Let S > 0, V and r be such that 
(|7.9p holds, and suppose x G V, y' e Six) and y E B(y, ?-). Let t > he such 
that y — y' E tC. Then we have x E S~^iy) + (T' + d)iy — y'), which implies 
X E S-^iy) + (T + S)itC). This in turn means that (|7Tg| holds, so S is (C,r)- 
metrically regular at (x, y). 

For the converse, recall eB C C C RM and examine the condition (|7.10p . If 
y ~ y' E ^M, then the minimum t > such that y — y' EtC gives tC C rB, so the 
condition tC C rB is superfluous in (|7.10p . □ 

8. Strict T-differentiability from outer T-differentiability 

Suppose S" : X ^ y is such that y E Six), T : X ^ Y is positively homogeneous, 
and S : X ^ Y is pseudo strictly T-differentiable at x for y. Then for any 6 > 0, 
there are neighborhoods U oi x and V oi y such that S is pseudo outer (T + S)- 
differentiable at x for y for all x E U and y E V D Six). The main theorem in this 
section is to show that the converse holds with additional assumptions. 

We now study the relationship between pseudo outer T-differentiability and 
pseudo strict T-differentiability. The relation between pseudo (outer/ strict) T- 
differentiability and (outer/ strict) T-differentiability can be obtained from The- 
orem [531 First, here is a lemma on pseudo outer T-differentiable functions on a 
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convex set that is comparable to the second part of [40l Theorem 9.2]. This has 
been extended from resuhs in |261 137). 

Lemma 8.1. (Pseudo outer T -differentiability) Let D d X be a convex set, and 
S : D ^ M" be a set-valued map satisfying y G S{x). Assume that T : X ^ M" is a 
positively homogeneous closed valued set-valued map and \T\~^ < k for some k > 0. 
Suppose that 

(1) hminfa-' — ^-^ S{x') D S{x) nB(y,r) with respect to D for all x £ D (This is 

D 

true when S is inner semicontinuous.), and 

(2) S is pseudo outer T -differ entiable for all x ^ D and y G S{x) D B(j/, r), 
Then for any S > 0, xo,xi Cz D and r' satisfying (k + d)\xo — xi \ + r' < r, we have 
Sixi) n M{y, r') C S{xo) + (T + S){xi - xo). 

Proof. By the definition of pseudo T-differentiabihty, for any S > 0, x G D and 
y G S{x) n B(y, r), there are neighborhoods V(^^ y-) of x and U(^x.y) of y such that 

S{x') n C S{x) + {T + d){x' - x) for aU x' e D n V(^^^y). 

Since S{x) D B(y, r) is compact, we may choose yi, . . . , j/fc G B(y, r) such that 

S{x)nMiy,r)(lutiU(^.,y,)- 

Let Ux be the right hand side of the above formula. Clearly, Ux U [B(y,r)]'^ is an 
open set containing S'(x), where [B(y,r)]^ is the complement of B(j/,r). Since S is 
outer semicontinuous, this implies that there is some neighborhood Vx C r\^^iV(^x,yi) 
such that S{x') CUxH [M{y,r)Y for all x' G K, which implies that 

S{x') n B(y, r) C Ux for aU x' G 14. 

This gives us 

(8.1) S{x') n M{y, r) C S^x) + (T + S){x' - x) for all G Z? n K. 

Pick Xo, xi G D. For each t G (0, 1), let xt = (1 — t)xo + txi. Formula (|8.ip ensures 
that for each t G [0, 1], there is a ball M{xt,pt) such that for each x' in Dr\M{xt, pt), 
S{x') n M{y, r) C S{xt) + (T + - xt). Here, 1 denotes an open ball. Define 

T := sup{t G [0, 1] I for each s G [0,t], 

S{xs) n B(y, r - (k + 5)\xs - xo\) C S{xn) + (T + - xo)}. 

We have r > because po is positive. We show first that 

(8.2) S{xr) nM{y,r - {k + S)\xr ~ x„\) C S{xo) + {T + S){xr ~ xq). 

By assumption the set S{xo) is closed, and therefore so is S{xo) + {T -\-6){xr — a;o); 
let Q be the complement of the latter set. If ()8.2|) were not true, then S{xt) would 
meet the open set Qr\M{y,r— {k-\-S)\xt — xo\), at y say. If xq, xi were close enough 
to X, then y G S{xr) nB(y,r) C liminf^^'^j;^ S{x'). Therefore, for any f > 0, there 
exists some e > such that 

|x' - a;^| < e implies S{x') n M{y, r) =^ 0. 

If (7 G (0, r) is such that \xa- ~ x^l < e, then S'(a;(j) H B(y, f) 7^ 0. If f is such that 
B(j/,f) C 1(2/, r - (k + (5)|2;r - xo\), then 

[5(xo) + (T + (5)(a-, - xo)] n B(y, 7^) ^ 0. 

We can find 2/0- such that — ^o-l < r, and y^- G S{xo) + {T+S){xcr — xo). Next, recall 
that S'(xo) + (r+(5)(a;^-xo) = S{xo) + {T-^'S){xr~x„) + {T+5){xa~xo)- This means 
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that there exists ya & S {xo) + {T + S){xt — xo) for which \ycT~ycr\ < {K, + S)\xT^Xa-\- 
Combining the two gives 

d(y, S{xo) + (T + S){xr - xq)) < \y - ya \ + IVa - Val < r + (k + S)\xr - x^\. 

Since the sum on the right hand side can be made arbitrarily small, we have y e 
S{xo) + (T + S){xr — xq), which contradicts y £ Q. This establishes (|8.2p . 
If T were less than 1 there would be A € (t, 1) with \xx — Xt\ < Pn such that 

(8.3) Sixx) n B(y, r - (as + d)\x), - Xo\) ^ S{xo) + (T + S){xx - Xo). 
However, we would then have from (|8.2p and the definition of pr, 

S{xx) n B(y,r - (k + 5)\xx - xo\) C 5(x,) + (T + d)ixx - Xr), 

and so 

s{xx) nniy,r - iK + S)\xx ~ xo\) 

C [S{xr) + {T + S)ixx - Xr)] n B(y, r - (k + <5)|xa - xo\) 
= n B(y, r - (k + (5)|a;, - xo|)] + (T + 6)ixx ~ Xr)) 

nM{y,r^{K + 5)\xx-xo\) 
C {[S{xo) + {T + d){xr - xo)] + (T + ,5)(a:A - x,)) 

nB(y,r- (k + (5)|xa -xol) 
C S{xo) + {T + S){xx-xo), 

where the inclusion in the last line holds because xq, Xt and xx are coUinear and 
T is a positively homogeneous convex valued map. This contradicts (j8.3p . so r 
must be 1. Putting r = 1 in shows that S{xi) n B(?;, r - (k + 5)\xi ~ xo\) C 
S{xq) + (T + 5){xi — Xq). The required conclusion follows immediately. □ 

By decreasing r and/or the size of D, we deduce that S is pseudo strictly T- 
differentiable at x for u. This is summarized in the theorem below. 

Theorem 8.2. (Pseudo strict T -differentiability from pseudo outer T -differentia- 
bility) Suppose that S : D ^ M" and y g S{x), where D = dom(S') d X is convex. 
Let T : X ^ R" a positively homogeneous closed valued set-valued map such that 
l£ ^ for some k > 0. If for any 6 > 0, there exists open convex sets U of x 
and V of y such that 

(1) S is pseudo outer [T + 5) -differentiate at x for y whenever x £ U , y £ V 
and y € S{x), 

(2) liminf^/ — )-x S{x') Z) S{x) D V for all x £ U . (This is true when S is inner 

D 

semicontinuous.) 

then S is pseudo strictly T -differentiate at x for y. Furthermore, the conclusion 
still holds if we amend condition (1) to: 

(la) S is pseudo outer [T + 5) -differentiate at x for y whenever x £ U , y £ V 

and y G >5'(a;) but (x, y) ^ {x, y), and 
(lb) S is outer semicontinuous at x. 

Proof. Choose any 6 > 0. There are open sets U containing x and B(y, r) containing 
y, such that S is pseudo outer (T + (5)-differentiable at x for y for all x G U, 
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y G M{y, r). We can reduce the size of U so that the diameter of U, say d, satisfies 
r - (k + 2S)d > 0. Let r' = i[r - (k + 25)d]. By Lemma O 

S{xi) n B(y, r') C S{xo) + (T + 2S){xi - xq) for all xo, xieUnD. 

Since S is arbitrary, S is pseudo strictly T-differentiable at x for y as needed. 

To prove the second part, we only need to prove that if both conditions (la) 
and (lb) hold, then S is pseudo outer (T + 2(5)-difFerentiable at x for y. Again, 
suppose we have neighborhoods U of x and V = B(j/, r) of y respectively such that 
condition (la) holds. First, we prove that for all x E M{x, ^) OU H D, 



(8.4) 



Six) n B (y, C Six) + (T + 26)ix - x). 



Since S is outer semicontinuous at a;, for any e > 0, there exists a convex combina- 
tion of {x, x\ arbitrarily close enough to x, say x. such that 



S'(x)n: 



y,- + (K + 25)|a:- 



c Six) 



Choose the domain D' to be B(i(i + a:), i|i — a;|). Both x,i are in Z3', which is 
convex, and ^ + K|a; — i:| < r, so the conditions for Lemma |8. II are satisfied, and we 
have 



Six) n B (y, C Six) + (T + 25)(a; - x). 



Then 



Six) n B (y, ^ 



c 

c 
c 



+ (T + 2(5)(a;-£)) nB(y,0 
- (T + 2(5)(x-i) 



[5(x) + (T + 2<5)(x-x)]nB(y,^ 
( S'(x) n B (^y, ^ + (k + 2(5)|x - x\ 

5(.T)nB(j/, ^ + (K + 2(5)|a;-5|) 

[S'(i) + eB] + (T + 2(5)(a;-i) 
= S'(:e) + (T + 2(5)(x-i:) + eB. 
For any fixed choice of e > 0, we can always choose x close enough to x so that 

iT^2b)ix-x) C (T + 2,5)(a;-x) + eB 

C (T + 2,5)(a;-x) + [e+ (k + 2<5)|x-5|]B. 

Since e is arbitrary, we have S'(x)nB(y, ^) C S'(a;)-|-(T+2(5)(a;— x). As a; is arbitrary 
in B(a;, ^) H J7 fl D, this means that S" is pseudo outer (T + (5)-differentiable at x 
for j/, and we are done. □ 

The corollary below addresses calmness and Lipschitz continuity. We did not 
explicitly treat the case where either the Lipschitz or calmness moduli could be 
infinity, but this is still easy. 

Corollary 8.3. (Calmness and Lipschitz moduli) Suppose that S : D ^ M" ise 
closed valued with D = dom(S') C X and y G Six). We have 

lipiS'(a; I y) > limsup clmS'(x | y). 



;ph(S) 



If D is locally convex at x, and there exist neighborhoods V of x and W of y such 
that liminfj:' — Six') D Six)nW for all x V (which is the case when S is inner 
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semicontinuous) , then equality holds. IJ in addition, S is outer semicontinuous at 
X, then we also have 

lipS'(a; I y) = limsup clinS'(a; | y). 

gph(S) 

In the single- valued case, we have the following corollary. 

Corollary 8.4. (Single-valued functions) Let f : D ^ K" be continuous, where 
D <Z X is convex. 

(1) Let T : X ^ R" be a closed-valued positively homogeneous map such that 
\T\'^ is finite. The function f is strictly T -differentiable at x if and only if 
for all 6 > Q, there is a convex neighborhood U of x such that f is {T + 5)- 
differentiable at all points in U H D. 

(2) For any x Cz D, 

lip/(a;) = linisupclm/(a;). 
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